Physical limits on information processing 



Stephen D. H. HsiQ 
Institute of Theoretical Science 
University of Oregon, Eugene, OR 97403 

We derive a fundamental upper bound on the rate at which a device can process information 
(i.e., the number of logical operations per unit time), arising from quantum mechanics and general 
relativity. In Planck units a device of volume V can execute no more than the cube root of V 
operations per unit time. We compare this to the rate of information processing performed by 
nature in the evolution of physical systems, and find a connection to black hole entropy and the 
holographic principle. 
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In this note we derive an upper bound on the rate at 
which a device can process information. We define this 
rate as the number of logical operations per unit time, de- 
noted as the ops rate 1Z. The operations in question can 
be those of either classical or quantum computers. The 
basis of our result can be stated very simply: information 
processing requires energy, and general relativity limits 
the energy density of any object that does not collapse to 
a black hole. Replacing information processing by infor- 
mation in the previous sentence leads to holography or 
black hole entropy bounds, a connection we will explore 
further below. For related work on fundamental physical 
limits to computation, see p| and 0]. We use Planck 
units throughout, in which the speed of light, Planck's 
constant and the Planck mass (equivalently, Newton's 
constant) are unity. 

Our result is easily deduced using the Margolus- 
Levitin (ML) theorem Q from quantum mechanics, and 
the hoop conjecture from general relativity, originally for- 
mulated by Thorne |4| . 

The Margolus-Levitin theorem states that a quan- 
tum system with average energy E requires at least 
At > \E~ X to evolve into an orthogonal (distinguish- 
able) state. It is easy to provide a heuristic justification of 
this result. For an energy eigenstate of energy E, E^ 1 is 
the time required for its phase to change by order one. In 
a two state system the energy level splitting E is at most 
of order the average energy of the two levels. Then, the 
usual energy-time uncertainty principle suggests that the 
system cannot be made to undergo a controlled quantum 
jump on timcscalcs much less than E^ 1 , as this would 
introduce energy larger than the splitting into the sys- 
tem. 

The hoop conjecture gives a criteria for gravitational 
collapse. It states that a system of total energy M, if 
confined to a sphere of radius L < rjM (r) is a coefficient 
of order one, which we neglect below), must inevitably 
evolve into a black hole. The condition L < M is read- 
ily motivated by the Schwarzschild radius R s = 2M. 
This conjecture has been confirmed in astrophysically- 
motivated numerical simulations, and has been placed 



on even stronger footing by recent results on black hole 
formation from relativistic particle collisions These 
results show that, even in the case when all of the en- 
ergy M is provided by the kinetic energy of two highly 
boosted particles, a black hole forms whenever the parti- 
cles pass within a distance of order M of each other. Two 
particle collisions had seemed the most likely to provide 
a counterexample to the conjecture, since the consider- 
able energy of each particle might have allowed escape 
from gravitational collapse. One can think of the hoop 
conjecture as requiring that the average energy density 
of an object of size L be bounded above by L~ 2 in order 
not to collapse to a black hole. Thus, large objects which 
are not black holes must be less and less dense. 

Our main result follows directly. Consider a device 
of size L and volume V ~ L 3 , comprised of n individ- 
ual components 6] of average energy E. Then, the ML 
theorem gives an upper bound on the total number of 
operations per unit time 



K<nE , 

while the hoop conjecture requires M 
bined, we obtain 

K<L~ V 1/3 . 



(1) 



nE < L. Com- 



(2) 
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It is interesting to compare this bound to the rate of 
information processing performed by nature in the evo- 
lution of physical systems. At first glance, there appears 
to be a problem since one typically assumes the num- 
ber of degrees of freedom in a region is proportional to 
V (is extensive) . Then, the amount of information pro- 
cessing necessary to evolve such a system in time grows 
much faster than our bound © as V increases. Recall 
that for n degrees of freedom (for simplicity, qubits), the 
dimension of Hilbert space H is N — dim H — 2" and 
the entropy is S = In N ~ n. In the extensive case, 
n~ 5~ V. 

However, gravity also constrains the maximum infor- 
mation content (entropy S) of a region of space, 't 
Hooft [2| showed that if one excludes states from the 
Hilbert space whose energies are so large that they would 
have already caused gravitational collapse, one obtains 
S = In TV < A 3 / 4 , where N is the number of degrees of 
freedom and A the surface area. To deduce this result, 
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't Hooft replaces the system under study with a thermal 
one. The number of states of a system with constant total 
energy M is given to high accuracy by the thermal result 
in the large volume limit (recall the relation between the 
microcanonical and canonical ensembles in statistical me- 
chanics). Given a thermal region of radius L and temper- 
ature T, we have S ~ T 3 L 3 and M ~ T 4 L 3 . Requiring 
M < L then implies T ~ L" 1 / 2 and S < L 3 / 2 ~ A 3 / 4 . 
We stress that the thermal replacement is just a calcu- 
lational trick: temperature plays no role in the results, 
which can also be obtained by direct counting. In it 
was shown that imposing the condition Tr[ pH] < L on 
a density matrix p implies a similar bound SVn < A 3 / 4 
on the von Neumann entropy SVn = — Trplnp. For p 
a pure state the result reduces to the previous Hilbcrt 
space counting. We note that these bounds are more 
restrictive than the bound obtained from black hole en- 
tropy: S < A 0- One can interpret this discrepancy as 
a consequence of higher entropy density of gravitational 
degrees of freedom relative to ordinary matter [To| . 



Using these results we can calculate the maximum rate 
of information processing necessary to simulate any phys- 
ical system of volume V which is not a black hole. The 
rate 1Z is given by the number of degrees of freedom 
S ~ L 3 / 2 times the maximal ML rate T ~ L~ x / 2 . This 
yields 1Z ~ L as in our bound J5J. 

Finally, we note that black holes themselves appear to 
saturate our bound. If we take the black hole entropy to 
be S ~ A ~ L 2 , and the typical energy of its modes to 
be the Hawking temperature Tjj ~ L , we again obtain 
L. 
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